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METHOD AND APPATATUS FOR DEINTERLACCING OF VIDEO USUNG MOTION COMPENSATED TEMPOR 
AL INTERPOLATION 



FIELD OF THE INVENTION 

The invention relates to a video encoder/decoder, and more particularly to a 
method and apparatus which can be used in low bitrate video compression applications. 

5 BACKGROUND OF THE INVENTION 

The TV standards which have been used for many decades make use of so- 
called interlaced video signals. This method allows a reduction of the required bandwidth for 
transmission by a factor of 2, without comprising the picture quality in normal cases. For 
most moments during a sequence, still a relatively high resolution is offered (when the 

1 0 motion is not too great), yet for moments with a lot of motion, e.g., sporting events, the 

picture rate (50 or 60 Hz) is still relatively high enough in order to prevent annoying judder 
effects. 

Because of the massive amounts of data inherent in digital video, the 
transmission of full-motion, high-definition digital video signals is a significant problem. 
1 5 More particularly, each digital image frame is a still image formed from an array of pixels 
according to the display resolution of a particular system. As a result, the amounts of raw 
digital information included in high-resolution video sequences are massive. In order to 
reduce the amount of data that must be sent, compression schemes are used to compress the 
data. Various video compression standards or processes have been established, including, 

20 MPEG-2, MPEG-4, and H.263. 

Applying video compression using known compression techniques as MPEG- 
2 to video signals at the same pixel rate, compression is more efficient for progressive (non- 
interlaced, e.g. 720M80@30Hz) signals as for interlaced signals (720*240*2@30H2 or also 

known as 720*480i@60H2). 
25 The DVD standard allows various formats which have different resolutions. 

The lower resolution formats are very useful for reducing the bitrate and therefore the 
recording time possible on a DVD disc. Most DVD formats are interlaced formats, at the full 
picture rate (50 or 60 Hz). The lowest resolution formats, also known as SIF or GIF 
(352*240 and 352*288) however, are only used as progressive format at reduced picture rates 
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(25 or 30 Hz instead of 50 or 60 Hz), and are veiy suitable for long recording times because 
of the relative low bitrates needed for MPEG compression. 

With respect to judder effects, judder effects are not a problem for pictures . 
recorded with a celluloid camera, e.g. movies. The reason why pictures recoded with a 

5 celluloid camera show little judder effects is because of the shutter behavior of the camera. 
The long open time of the shutter causes a kind of smearing (temporal filtering) of fast 
moving objects due to the integration of photons on the celluloid. However, for pictures 
recorded with an interlace video camera with fast motion like sports, the judder effects are 
quite annoying. To enable recording times of 8 hours or more on a single DVD disc, the SIF 

10 formats can and will be used. However, the use of this format has the drawback of annoying 
judder effects for the recording of fast moving pictures. As a result* there is a need for a 
method for reducing the judder effects associated with fast moving pictures when SIF 
.formats are used. 

1 5 SUMMARY OF THE INVENTION 

The invention overcomes the deficiencies of other known schemes by 
electronically emulating the smearing of a celluloid camera prior to the use of low bitrate 
video compression applications. 

According to one embodiment of the invention, a method and an apparatus for 

20 processing an interlaced video signal is disclosed. First, the interlaced video signal is de- 
interlaced. A plurality of temporal interpolated frames between original frames of the 
interlaced video signal are created using motion compensated temporal interpolation. The 
plurality of temporal interpolated frames and original frames are temporal filtered to produce 
an output video signal. 

25 These and other aspects of the invention will be apparent from and elucidated 

with reference to the embodiments described hereafter. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will now be described, by way of example, with reference to the 

30 accompanying drawings, wherein: 

Figure 1 is a block diagram of a temporal interpolation unit according to one 

embodiment of the invention; 

Figure 2 illustrates the video stream at various stages of processing according 

to one embodiment of the invention; and 
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Figures 3(aHb) illustrates various filter shapes which can be employed by the 

invention. 

DETAILED DESCRIPTION OF THE INVENTION 
S Figure I illustrates a temporal interpolation unit 100 according to one 

embodiment of the invention. The temporal interpolation unit 100 will now be described 
with reference to Figures I and 2. An interlaced video input stream 102 is inputted into a de- 
interlacer 104. The de-interlacer 104 de-interlaces the input video, stream and produces a de- 
interlaced video stream. The de-interlaced video stream is provided to a temporal 

10 interpolator 106, The temporal interpolator 106 creates a plurality of correctly temporal 

interpolated frames between each original frames of the normal interlaced video signal. The 
temporal interpolator 106 is performing motion estimation on the received frames. The 
calculated motion vectors can be scaled to any arbitrary position between two received 
frames, enabling motion compensation with these scaled vectors to construct a motion 

15 compensated frame on any arbitrary (desired) position in time. It will be understood by one 
skilled in the art that the temporal interpolator 106 may also use bi-directional motion 
estimation and compensation. Furthermore, the temporal interpolation may also use natural 
motion. A practical implementation is based on three-dimensional recursive search (3DRS) 
which is suitable for consumer applications, sec for example the U.S. Patents 5 072 293. 

20 5 148 269, arid 5 212 548. 

As shown in Figure 2, a large number of temporal interpolated frames 204 are 
created in between each original frame 202. The original frames 202 and the temporal 
interpolated frames 204 are then filtered by a temporal fiher 108. The filtering over 2n+l 
frames in order to construct one filtered frame (F) is performed by multiplying every given 

25 pixel (x,y) in frame i with its corresponding filter coefficient (i): 

/>,(x.;')=2:::-(')*^('X*.>') 

In this illustrative example, the filter 108 comprises a plurality of 
30 multiplication devices 1 10 which multiply the respective original and temporal interpolated 
frames by a coefficient (c-5, c.4, c-3, c-2, c-l, cO, cl. c2, c3, c4, and c5). In this illustrative 
example, the multiplication devices are spaced apart by 8 ms and the total distance between 
C-5 and c5 is 40ms, but the invention Is not limited thereto. The value of each coefficient is 
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dependent on the shape of the filter being used. Figures 3(aHb) illustrate several filter 
shapes which can be used, but the invention is not linDited thereto. The output values from 
the multipliers 110 are accumulated in an accumulator 1 12, 

The accumulator 1 12 outputs a "celluloid" type signal 206 which can now be 

5 compressed into a very low bitrate making good use of the progressive SIF format, where the 
annoying judder effects are now largely avoided. As illustrated in Figure 1, the signal 206 
can be provided to an MPEG progressive encoder 1 14 for further processing. 

It will be understood by those skilled in the art that the invention can also be 
applied for other types of formats, e.g., to convert full resolution 720*240*2@30Hz interlace 

1 0 into 720*480@30Hz progressive or for other application than DVD applications. It will be 
understood that the different embodiments of the invention are not limited to the exact order 
of the above-described steps as the timing of some steps can be interchanged without 
affecting the overall operation of the invention. Furthermore, the term "comprising" does not 
exclude other elements or steps, the terms "a" and "an" do not exclude a plurality and a 

1 5 single processor or other unit may fulfill the functions of several of the units or circuits 
recited in the claims. 



